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ABSTRACT 

A principal limitation of LISP processors in many computa¬ 
tions is chat of Inadequate primary random-access storage. This 
paper explores severs! methods of using a secondary storage 
medium (such es drums, disk files or magnetic tape) to augment 
primary storage capacity and points out some limitations of 
these methods. 
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A principal limitation of the LISP language, when performing large 
computations, la saturation of primary random-access storage with active 
material, both functions (programs) and lift structures. When saturation 
occurs, the computation is forced to terminate and one wonders to what 
extent secondary storage media (such as drum, disk file or magnetic tape) 
can be used to allow the computation to continue. In general there is no 
reason to suppose th*t anything short of more primary storage can help, 
except at the cost of a reduction In the computation rate by several orders 
of »*gnitude--do*m to the random access rate of a secondary storsge media. 
However, in some cases one car. make better use of the primary storage medium 
while in other cases use of secondary storage may be worthwhile to allow 
the completion of a computation at a somewhat higher cose. 

This paper will investigate several methods of using secondary storage 
to augment the computing capacity of a given LISP Processor. Most of these 
remarks will be directed toward a LIS? processor on the IBM 7094, but may 
be generalised to LISP processors on other machines or other list proces¬ 
sing languages. In particular the primary storage media will be called 
core and the secondary storage will be called tape, disk file or drum 
storage. It should be noted, however, that many of these ideas require 
e gross rewriting of the current 7094 LISP 1.5 processor if they are to 
be successfully Implemented. 
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Lisp Functions 

A. Library Tape 

A more efficient use of core storage would be made if the LISP user 
could specify those LISP ftmctions he intended to use in the current com¬ 
putation. These functions could thea be celled from secondary storage 
such as a library tape and the room left in core after the functions are 
loaded could be allocated between list structure storage and pushdown list. 
The LISP library tape could store compiled functions, functions as S-expres- 
sions, or both. Each function on the library tape would specify its name 
and the subfunctions it needed and loading could take place in a manner 
similar to the Fortran Monitor BSS library tape. This method still restricts 
the user to one core-full of active material at any one time and this core¬ 
full must contain all the functions he will use during the computation 
whether currently active or not. 

B. Ring Buffer Function Storag e 

This method of storing functions is intended for use with a relatively 
fast drum as secondary storage. It allows the user to have as many active 

functions in compiled form as he wishes. 

First a portion of core is set aside as a program ring buffer. Each 
compiled program is required to keep all of its temporary storage on the 
pushdown list and all function calls and returns must be made through a 
fixed transfer vector which indicates which functions are in the ring buf¬ 
fer at any one time. When a function is called which is not in the buffer, 
it is fetched from the drum and read into successively higher locations in 
the buffer. If the top of the buffer is reached the program starts over 
at the bottom. Since all temporary storage of active functions is on the 
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pushdown list, currently eetive function# Med never be read out. In the 
uor»t case ^a cyclic set of function* which will not fie simultaneously 
Into the ring buffer), the.function execution time will approach the drum 
rotation speed. However, in typical LISP computations much time might elapse 
before a function i« celled that U not in the ring buffer and if til the 

needed functions fit into the ring buffer, the computation will run st 
full mechfua speed. 

. 0 

TS»g ring buffer zcathod might be combined with a compacting garbage 
collector * JU Minsky and the ring buffer liet-structure-storage boundary 
■ay be changed according to the needs of the computation. 

C- Unu sed Function Beclaration * 

Ev an if it ie not desired to .implement either of the above methods 
for function storage, one way of making better usa of core storage Is 
to ^eliminate the requirement that all LISP functions which ma£ be used 
in a omputition be in core* An .example of this requirement in 7094 LISP 
Is tb: character handling and array handling functions* Many computations 
do c> use either of these features but the space oust be currently set 
asi/e as there is no provision for reclaiming this space. Ibis space could 
be made available if the user could declare those baalc functions which 
hr/ does not intend to use and let the garbage collector turn these areas 
lito free storage* this method would involve making a slightly more com¬ 
plicated garbage collector, and more study on individual cases would have 
to be made to determine whether the gain in apace would offset the increased 
garbage collection time and complexity Note that this idea is implicitly 
contained In both the library tape and program ring buffer methods described 


above* 
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Stpictu v* and Secondary Stora p* 

Many of the problems of »ln* secondary storage with LISP arise free 

th * taet th,t lISP ‘HWI list* to here subllstj la eoaaoa. Othar 

U*t processors such at thraaded list* do not allow canon subllats and 
th«» .void .an of the .oeoodary storage problem*. Romevcr. it 1 , the ~ 
*uthor*a opinion that th* core (no common evbllets) la worse than tha 
dlaoaaa (hard to meke „„ of secondary .tors*.) because the computation 

cat* la ouch .lower when time and etorege is spent copying and recopylng 
subllsts which could be kept In common. 

A ‘ ISfiiSK 

One method of using secondary stor.ge In LISP is to dtvtds core Into 
e number of block, known as page, in mannet similar to tha Ferranti Atlas 
computer. Storage reference, within a ,lvan page proceed normally, while 
croes peg. references use . eubroutine tc determine if the referenced peg. 
le In core. If not. one of the pages in core Is read out onto a drum or 
disk and the required page reed In. This method has been programmed for 
list etructure. on the KIT PDF-1 computer with an 88,000 word drum. This 
computer Is a 4,096 word, 18 bit, 5 microsecond machine with s LISP pro¬ 
cessor which he. 800 word, of free storege in core. Unfortunately, m 
processing 11,t atructuras there la no good method known for reducing the 
number of cross page references and on e large problem, the computation 
•peed 1. quickly reduced to the drum rotation speed. As an example, one 
aet of functions, which the 7094 reads In In a few second., required 5 
hours to reed In with PDP-1 LISP. Other .computations performed on both 
PDP-1 LISP and 7094 LISP show the paging method, In feet, limits the com- 
potation speed to the drum rotation speed. 
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B. Read -Print wit h Vert at long 

Soften the paging tcaihod mentioned above is wasteful of central pro¬ 
cessor time, It has been propstd to let the prograiaaer create his own file 
system in secondary storsge and then allow his'to print out list structures 
with the LISP PRINT program end read them back in with READ. This method 
suffers because READ and PRINT are net fast progratae and no method to pre¬ 
serve common list subexpressions i& provided. The first objection way be 
tolerated but'the second can have eataatrophic results. Consider the liat 
structure known colloquially as a BLAH llet anti represented it» box notation 



A BLAM lint Is a valid piece of list structure in chat it Is not circular, 
but when copied without preserving ccrmou subexpressions a BIAM liat of a 
words uses 2 n words of fre* storage. The BLAH liat la not as far-fetched 
aa it may see© at first since, under certain circumstances, the pair-list 
in the current LISP 1.5 interpreter has BIAM list characteristics. 

Various methods for speeding up the READ-PRINT process such as encoding 
the atoms may be envisioned hut failure to preserve ccesraon subexpressions 
in the list structure is still a big objection. 

One method of preserving common ?ubaxpress ions would be to allow the 
user to read out blocks of list structures in a compactad forte such ae sug¬ 
gested in Minsky's garbage collector paper, This method has the additional 
advantage of being fairly last on read-out and very fast on reading In as 
free e rorage Is kept in a blech. 
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Any of the above methods for letting the user put out and call back 
Hat structures might allow some computations to be carried out which 
could not be done otherwise. An example could be the symbolic differ¬ 
entiation of a series which could be handled term by term with only one 
term in core at a time. 

C. Automatic Compacting List Structure Dump 

Another method to utilize secondary storage in LISP would be to 
program an automatic list structure dump program in conjenction with the 
garbage collector. Initially, the program would be allowed to run until 
all core ia filled with active Hat structure. At this point the garbage 
collector would mark backwards along the moat recent part of the pushdown 
list until one-half of available core storage ia marked, Then the list 
structure referred tc by the rest of the pushdown list would be compacted 
and filed in secondary storage. This list structure would be retrieved 
when the pushdown list got back to the point where the filed material was 
needed. 

This method of automatic dumping assumes that atomic symbols are 
always present and none of the relevant properties are changed during the 
course of the computation. This method also assumes, during the course 
of the computation, list structures are found in disjoint pieces which may 
or may net be the case. That is to say that it is possible that during 
a computation most of the active list structures are referred to by the 
s»ost recent items on the pushdown list- It should be noted that items 
referred to on the older part of the pushdown list cannot dumped if they 
have subexpressions in common items referred to on the recent part of the 
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liar. I„ order to dump th. older items either eh. co-o„ . ub .z 
«pt...lo n . would heve to be copled-which t. unde.ir.bl. fro- . eeoreg. 
potee of viav.. or the co«on aubexprea.ion. would heve eo be «. ct ly pr .. 

•«rv«d which ia quite herd when uaiov « 

•log a compacting garbage collector. 

D# Ahead Method* 

B>« l«t end by f.r the -o.t epecul.tlw. method for using aecond.ry 
•torege uould be in function with the compii.r. Zf during the courae 
Of . computation, certain relatively f Ue d U.ta, . ueh .. dictionerie. or 

‘""' d ** th . 

““ I«* •>»«, .. »,« th . 

piled program would atari * 

getting itema from secondary storage via data 

channels before they were actually needed In hh. 

y * a ‘ In Mis vas the central pro- 

cessor could be kept running at almoa't full ap,ed. 

B* Coneluaion 

a. abov. method, t.nd to .how, ..cond.ry ator.g. i, r.th.r h . rd to u . t 
for atoring li.t atructure. during . L ZSP computation. It i. t h. author', 
opinion that the trade-off factor between primary and aecendary stor . ge 
i. about 30 to 1 in favor 0 f more primary atorage (i.,.. z uolt of prJ . 

■•ry atoraga 1. worth 30 unit, of aecond.ry storage). However, in situ¬ 
ation. where more primary storage i. „ ot available aecond. 

* uaoie » aecondary atorage may 

bo uaed to aooe advantage in LISP. 



